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ABSTRACT 

The  objective  of  this  paper  is  to  review  the  anticipated  imaging  and  remote-sensing  technology  requirements  for  aerial 
vehicle  survey  missions  to  other  planetary  bodies  in  our  Solar  system  that  can  support  in-atmosphere  flight.  In  the  not 
too  distant  future  such  planetary  aerial  vehicle  (a.k.a.  aerial  explorers)  exploration  missions  will  become  feasible. 
Imaging  and  remote-sensing  observations  will  be  a  key  objective  for  these  missions.  Accordingly,  it  is  imperative  that 
optimal  solutions  in  terms  of  imaging  acquisition  and  real-time  autonomous  analysis  of  image  data  sets  be  developed  for 
such  vehicles. 
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1.  INTRODUCTION 

Many  planetary  missions  involving  the  use  of  aerial  vehicles  have  been  proposed8.  A  considerable  body  of  research  has 
focused  on  the  aircraft  design  challenges  of  these  vehicles.  However,  only  cursory  treatment  has  been  given  to  the 
imaging  and  remote- sensing  ramifications  of  such  missions.  This  work  sets  out  to  address  this  situation  by  searching  out 
the  common  threads  with  respect  to  imaging  and  remote-sensing  of  a  wide  range  of  notional  aerial  explorer  missions.  In 
that  respect,  two  broad  categories  of  aerial  explorer  imaging/remote-sensing  missions  immediately  suggest  themselves: 
missions  in  which  the  surface  of  a  planetary  body  is  observed  and  terrain  features  of  interest  are  identified  and  those 
missions  where  the  atmospheric  flow  field  and  chemical  constituents  are  to  be  assayed.  The  first  category  includes  aerial 
survey  missions  to  Mars,  Titan,  and  Venus  (where  there  is  both  adequate  atmospheric  density  for  flight  and  a  discrete 
and  accessible  planetary  surface).  The  later  category  includes  aerial  flow  field  or  chemistry  measurements  made  in  the 
upper  atmospheres  of  the  outer  planet  gas  giants  (where  there  are  no  discrete  or  accessible  surfaces  to  the  planetary 
cores). 

In  the  context  of  these  two  general  aerial  survey  mission  categories,  recommendations  are  made  as  to  requirements  and 
capabilities  for  imaging  cameras,  data  storage  and  transmittal  systems,  remote-sensing  systems  such  as  lidar,  radar, 
thermal  emission  spectrometry  and  other  techniques.  In  particular,  the  operational  and  environmental  constraints  of  such 
systems  are  discussed  with  respect  to  a  number  of  notional  aerial  explorer  missions.  The  necessity  for  the  integration  of 
science  instrument  suites  with  aerial  vehicle  navigation  and  mission  planning  systems  are  also  discussed.  An  integrated 
approach  is  necessary  because  of  the  need  to  perform  real-time  three-dimensional  mapping  of  terrain  or  atmospheric 
flow  fields  for  scientific  investigations  as  well  as  aerial  vehicle  navigation  and  hazard  avoidance. 

Uninhabited  Aerial  Vehicles  (UAVs)  have  been,  or  are  envisioned  to  support  many  different  tasks  on  Earth.  These 
include  military  (reconnaissance,  or  search  and  destroy),  local  (monitoring  crops,  power  lines,  or  borders)  and  long  range 
civil  monitoring  (ice  flows,  weather  patterns).  The  mission  of  a  planetary  air  vehicle  may  be  to  search  for  subtle  signs  of 
life  (as  in  water  or  methane  on  Mars)  or  characterizing  weather  patterns  and  water  vapor  updrafts  on  Jupiter  and  other 
gas  giant  planets. 
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Although  terrestrial  and  planetary  vehicles  and  missions  may  seem  similar,  planetary  vehicles  will  need  to  be  smarter, 
more  efficient,  and  robust  than  their  earthbound  brethren.  To  achieve  their  goals,  these  planetary  aerial  vehicles  may 
need  to  work  as  part  of  a  large  system  of  systems  (orbiters,  mother  and  daughter  ships,  rovers).  They  may  also  be  part  of 
a  mission  that  is  distributed  in  time.  Examples  of  such  a  distributed  time  approach  to  missions  include:  successive 
flights  of  similar  vehicles  or  the  distribution  of  sensors  that  provide  data  back  to  the  aerial  vehicle  during  the  flight,  but 
also  persist  beyond  the  flight  to  return  data  to  the  mission  scientists  for  months  afterward. 

Planetary  vehicles  will  be  required  to  navigate  and  perform  their  tasks  in  uncertain  and  largely  unknown  environments. 
In  general,  they  will  not  have  the  luxury  of  the  positive  position,  speed,  and  altitude  sensing  afforded  by  GPS.  For 
planets  such  as  Mars,  better  terrain  and  sensor  data  is  beginning  to  become  available  (via  orbiters  such  as  NASA’s  Mars 
Odyssey  and  the  ESA’s  Mars  Express),  but  at  the  resolution  needed  by  aerial  vehicles,  this  information  will  only  get 
them  close  to  the  area  of  interest.  In  the  case  of  the  exploration  of  the  atmosphere  of  gas  giants,  very  little  positioning 
information  will  be  available,  but  little  may  be  needed,  as  these  vehicles  will  be  navigating  within  and  around  general 
weather,  wind,  and  wind-borne  aerosol  patterns.  For  this  reason,  both  categories  of  vehicles  will  likely  navigate  using 
search  and  find  strategies  that  are  unlike  those  used  for  terrestrial  searches.  Rather  than  exhaustive  searches  over  known 
areas,  these  vehicles  will  use  broad  stochastic  or  biologically  based  behavioral  searches  to  find  evidence  of  areas  of 
interest,  followed  by  highly  efficient  searches  in  those  areas  that  follow  the  data  to  a  conclusion  or  resolution  of  a 
specific  line  of  scientific  inquiry. 

Planetary  aerial  vehicles  will  need  to  operate  with  limited  resources.  Because  they  will  not  be  able  to  land,  return,  or 
refuel  before  completing  their  mission  (fixed-wing  versions  of  aerial  explorers,  that  is),  these  vehicles  will  have  limited 
time  on  station  to  perform  their  work.  Because  of  the  need  for  lightweight  construction,  they  will  carry  limited 
fuel/energy,  electrical  power,  and  sensor  resources.  Most  research  will  need  to  be  performed  within  one  flight,  or 
multiple  flights  of  successive  single  flight  vehicles. 

Because  of  the  distance  from  Earth  and  the  significant  communication  turn-around  time,  these  vehicles  will  necessarily 
need  to  fly  and  make  decisions  autonomously.  There  will  be  no  human  in  the  loop;  at  best  there  may  be  encouragement 
or  recommendations  from  Earth  that  may  be  minutes  or  hours  old.  Exploration  vehicles  will  need  to  be  able  to  make 
decisions  based  on  their  best  guess  of  the  data  that  they  have  at  the  time,  trading  off  resources  and  time  in  the  decision¬ 
making.  In  addition  to  sensing  and  recognizing  information,  these  vehicles  will  also  need  to  be  able  to  recognize 
something  that  is  unfamiliar  -  primarily  by  finding  things  that  do  not  match  the  “typical”  characteristics  for  that 
environment.  Therefore,  the  paper  concludes  with  a  discussion  of  the  general  class  of  information  technology  problem 
suggested  by  robotic  navigation  -  investigation  -  in  uncertain  or  unknown  environments  (which,  with  the  arguable 
exception  of  Mars,  all  aerial  explorer  missions  to  other  planetary  bodies  fall  into). 


2.  CATEGORIZATION  OF  POTENTIAL  AERIAL  EXPLORER  MISSIONS 

Aerial  exploration  missions  can  be  divided  in  two  broad  categories:  those  that  entail  surface  imaging  and  interaction  of 
various  forms,  and  those  that  perform  atmospheric  environmental  sensing.  Aerial  explorers  for  planetary  bodies  such  as 
Earth,  Mars,  Titan  (Saturn’s  largest  moon),  and  Venus  -  because  of  their  discrete  and  accessible  surfaces  beneath  their 
atmospheres  -  can  perform  both  mission  categories  (though  perhaps  in  separate  individual  missions).  Aerial  explorers 
for  outer  gas-giant  planets  such  as  Jupiter,  Saturn,  Neptune,  and  Uranus  -  because  their  solid  inner  cores  are  inaccessible 
because  of  incredible  pressures  and  temperatures  -  can  only  perform  atmospheric  environmental  sensing  missions  in  the 
higher-altitude,  outer  atmospheres  of  these  planets.  Nonetheless,  an  extensive  array  of  mission  scenarios,  goals,  and 
vehicle  configurations  can  be  envisioned  that  fit  within  these  two  mission  categories  for  various  planetary  bodies  of 
interest. 

There  are  three  general  types  of  mission  capabilities  that  can  be  provided  by  planetary  aerial  vehicles:  observation  of  the 
surface,  subsurface,  or  atmosphere;  surface  interaction;  and  utility.  The  first  type  benefits  from  the  close-range 
measurements  that  the  aerial  explorer  can  make  while  traversing  over  large  distances;  geophysical  measurements 
(magnetic  field  and  ground  penetrating  radar)  benefit  especially.  Surface  interactions  call  for  the  aerial  explorer  to  be 
able  to  land  and  take  off  from  unprepared  sites  and/or  air-deploy  sensors  and  robotic  devices.  The  utility  category 


includes  tasks  such  as  acting  as  a  telecom  relay  for  other  ground  or  air  assets  for  over-the-horizon  communication,  i.e. 
supporting  and  enabling  science  investigations.  In  some  cases,  the  planetary  aerial  vehicles  will  act  in  total  isolation, 
until  completion  of  the  mission  and  subsequent  relay  of  data  to  Earth.  In  other  cases  the  aerial  explorers  will  work  in 
concert  with  a  network  of  robotic  devices,  intelligent  sensor  packages,  and  autonomous  robots  (e.g.  landers,  rovers,  and 
orbiters). 

This  paper  touches  briefly  on  the  aerial  survey  requirements  and  constraints  of  two  illustrative  examples  of  these  mission 
categories:  aerial  explorers  for  studying  the  Martian  surface  and  the  outer  atmosphere  of  Jupiter. 


2.1  Surface  imaging  and  interaction 

The  majority  of  our  work  involving  aerial  explorers  has  focused  on  surface  imaging  and  surface  interaction  for  Mars 
exploration2,3,5  7,8.  Both  fixed-wing  and  vertical  takeoff  and  landing  (VTOL)  vehicles  have  been  studied.  Surface 
interaction,  therefore,  in  our  investigations  has  taken  on  two  forms:  air-deployment  of  intelligent  sensors  and  small 
robotic  devices  from  fixed-wing  aerial  explorers,  and  the  landing  and  return  from  remote  sites  of  interest  with  vertical  lift 
aerial  vehicles.  This  work  primarily  discusses  surface  imaging  and  surface  interaction  in  the  context  of  fixed-wing  aerial 
explorers.  The  chief  challenges  for  performing  the  search  for  past  or  present  water,  precursor- to-life  organic  compounds, 
and  life  itself  on  Mars  (and  perhaps  Titan)  are:  1.  robust  flight  control,  especially  while  flying  at  low-attitude  and  near 
the  ground,  2.  autonomously  finding  terrain  features  of  interest  to  investigate  in  a  uncertain  or  unknown  environment, 
and  3.  devising  means  to  build  in  mission  persistence  to  maximize  scientific  return  on  investment,  mostly  by  means  of 
effecting  informational  or  physical  “symbiosis”  with  multiple  robotic  assets,  i.e.  a  kind  of  robotic  ecosystem3,4.  Further, 
the  study  of  the  inner  rocky  planets  provides  important  clues  as  to  geologic  processes  that  have  important  implications 
for  our  planet. 


2.2  Atmospheric  environment  sensing 

The  whole  issue  of  planetary  climatology  and  meteorology  is  an  area  of  current  discussion  and  interest27.  In  many 
regards,  studying  the  atmospheric  processes  of  other  planets  -  so  as  to  better  understand  our  own  planet  -  raises  even 
more  profound  questions  than  does  the  search  for  water  and  life  beyond  Earth  in  our  Solar  system  and  others.  For  such  a 
study  (including  a  large  diverse  collection  of  planets)  provides  important  clues  as  to  the  evolution  of  our 
atmosphere/biosphere  and  the  long-term  survivability  of  our  species  and  others.  Fixed-wing  aerial  explorers  quite 
rightly  dominate  this  general  category  of  missions.  There  is  little  need  for  VTOF-capability  if  the  primary  objective  of 
the  planetary  mission  is  the  study  of  the  planetary  body’s  atmospheric  dynamics  and  chemical  constituents.  We  have 
performed  only  limited  studies  to  date  in  this  aerial  explorer  mission  category11.  The  chief  challenges  for  performing 
such  studies  using  aerial  vehicles  are:  1.  achieving  robust  flight  control,  especially  in  hurricane-force  zonal  winds  and 
extreme  turbulence  and  density  gradients  well  beyond  terrestrial  experienced  magnitudes,  2.  prolonging  flight  duration 
and  extending  vehicle  range  through  a  variety  of  means  —  including  thermal  and  dynamic  soaring  and  partial  reliance  on 
semi-buoyant  lift  for  flight  in  the  outer  planets’  atmospheres  -  to  acquire  as  a  minimum  regional-scale,  diurnal  (or  other 
large  time-scale)  atmospheric  measurements,  and  3.  acquiring  and  relaying  data  to  orbiters  and  other  in-flight  aerial 
vehicles  to  insure  data  transfer  back  to  Earth  over  large  time-scales  (i.e.  greater  than  a  couple  of  hours). 


3.  A  “MAGNIFICENT  DESOLATION. .  .§” 

The  alien  landscapes  of  other  planetary  bodies  are  quite  unlike  anything  on  Earth.  True,  there  are  analog  sites  on  Earth 
where  certain  geological  and  astrobiological  features  seem  to  echo  features  seen  on  other  planets,  but  in  many  regards 
these  similarities  are  only  artifices  of  convenience.  The  surfaces  of  planetary  bodies  such  as  Mars,  Venus,  and  Titan 


§  Quoted  from  Buzz  Aldrin,  Apollo  1 1 ,  with  reference  to  observing  the  lunar  surface  prior  to  setting  foot  on  the  surface,  as  the  second 
man  in  history  to  do  so. 


indeed  reflect  “magnificent  desolation.”  If,  as  currently  prioritized,  the  primary  research  thrust  of  NASA  planetary 
science  missions  is  to  address  the  question  of  past  and  current  life  on  other  planetary  bodies,  then  the  whole  question  of 
aerial  surveys  must  be  assessed  in  that  context.  Therefore,  the  question  becomes:  how  can  the  existence  or  nonexistence 
of  water-formed/modified  minerals,  trace  organic  compounds,  or  micro-fossils  in  rocks  be  realistically  evaluated  from 
the  air,  using  an  autonomous  Mars  airplane  flying  at  Mach  0.4-0. 5  at  one  kilometer  above  the  Martian  surface8?  Signs  of 
ancient  water  and  perhaps  life  will  be  extremely  subtle  to  divine.  Not  only  will  high  levels  of  vehicle  autonomy  need  to 
be  provided  for  such  a  search  but  new  approaches  relying  upon  stochastic  and,  perhaps,  bio-inspired  search  and  find 
flight  behaviors  will  need  to  be  devised  for  such  aerial  surveys.  That  is  also  why,  in  addition  to  performing  aerial 
imaging  and  remote  sensing,  it  is  also  vitally  important  to  acquire  “ground-truth”  during  the  aerial  explorer  surveys6,7. 
A  variety  of  mechanisms  have  been  proposed  and  studied  in  prototype  form  in  order  to  capture  such  ground- truth3, 8. 

To  arrive  at  such  new  search  and  find  strategies  and  ground- truth  acquisition  methodologies  it  is  first  necessary  to  define 
the  terrain  features  of  interest  that  might  be  sought  after.  Table  1  contains  a  brief  list  of  these.  This  in  turn  will  suggest 
approaches  by  which  aerial  explorers  might  look  for  those  terrain  features  of  interest  -  inevitably  yielding  heuristics, 
rules,  and  hypotheses  that  will  be  incorporated  in  the  autonomous  system  implementation  of  a  planetary  aerial  vehicle. 
Further,  definition  of  such  a  set  of  terrain  features  of  interest  will  also  enable  the  definition  of  requirements  for  the 
sensors  to  be  used  for  the  aerial  vehicle  surveys. 


Table  1.  -  Terrain  Features  of  Interest,  Their  Evaluation,  and  Implications. 


Science 

Goal 

Terrain 

Feature  of 

Interest 

How  to  Evaluate 

Possible  Sensors  and  Imaging/Survey  Strategies 

Search  for 
Water 

Gullies 

Erosion  on  hillsides 

possibly  created  by  water. 

Sensitive  (scanning  laser)  altimeter  to  map  terrain. 
Imaging  comparison  against  known  classifier  forms 
at  Mars  analog  facilities. 

Ancient  River 
Basins 

Linear  ground  depressions. 

Sensitive  (radar)  altimeter,  mapping  of  terrain  to  find 
and  follow  possible  river  channel  from  start  to  finish. 
Image,  characterize  and  identify  terrain  color 
changes  associated  with  water-modified  mineral 
deposits. 

Chemical  distributions 

along  river  bank. 

Onboard  spectrometer  to  identify  and  map 
distributions. 

Delivery  of  chemical-assay  contact  pods  (single  or 
long  linear  rope-type)  to  verify  actual  composition. 

Rock  distributions  from 
large  boulders  to  smaller 
rocks  that  would  have  been 
deposited  by  ancient  water 
flow. 

Integration  of  spectrometer,  altimeter,  and  imaging 
sensor  data  to  map  and  recognize  size  and 
distribution  of  rocks. 

Vision-based  assessment  of  terrain  rockiness  and 
distribution.  Accurate  delivery  of  small  mobile  robot 
that  can  image  and  sample  rocks  and  boulders  up 
close. 

Water  Hillside 
Outflows 

Depressions  or  caves  in 
hillsides  where  water  may 
have  flowed  out  of  and  may 
still  exist 

Accurate  navigation  using  prior  3D  imaging  of  the 
hillsides  and  rivers  leading  to  them.  Sensitive 
forward-looking  radar  to  image  hillside  to  identify 
depressions.  Forward-looking  spectrometer  to 

identify  possible  residual  water. 

Accurate  placement  of  tetherbot  with  close  up 
spectrometer  and  imaging  capabilities.  Persistent 
tetherbot  supports  analysis  across  multiple  seasons  at 
this  site. 

Identification 
of  water  ice  in 
glacial  form. 

Identification  of  water- 
based  glacier  and  terrain 
beneath 

Downward-looking  radar  or  Lidar  to  identify 
differences  between  upper  surface  and  ground 
below.  Spectrometer  to  identify  water  in  ice  and 
possible  outflows. 

Contact  drop  pod  that  can  return  surface  and  near 
surface  content  to  verify  glacier. 

Deployment  of  subsurface  penetrator  pod  to  image 
and  sense  glacial  material.  Deployment  of  multiple 
persistent  penetrators  may  provide  verification  of 
glacial  drift. 

Existence  of 
Subsurface 

water. 

Water  located  below  the 
surface. 

3D  mapping  of  surface  to  identify  low  areas. 
Penetrating  radar  or  spectrometer  to  identify 
subsurface  areas. 

Deployment  of  surface  pods  to  characterize  surface, 
deploy  subsurface  penetrator  to  gather  imaging  and 
chemical  signatures. 

Search  for 
Life 

Existence  in 
Ancient  Lake 
Bottoms 
(Striated  rocks) 

Striated  rocks  on  hillsides 
may  indicate  riverbeds  and 
fossil  areas. 

3D  mapping  of  terrain.  Imaging  identification  of 
rock  areas. 

Subsurface  life 

Recognition  of  chemical 
processes  (Methane, 

chemical  signatures) 

identifiable  on  surface. 

Large  scale  search  of  surface  for  spectral  signatures. 
Lower  altitude  mapping  of  promising  area. 

Deployment  of  surface  imaging  and  contact  pods. 

Deployment  of  subsurface  penetrators  to  image  and 
subsurface  life. 

4.  THE  LANDSCAPE  OF  SKY:  MAPPING  THE  WIND... 

Understanding  the  atmospheric  dynamics  and  chemistry  of  the  upper  troposphere  of  outer  gas  giant  planets  in  our  solar 
system  could  be  greatly  expedited  by  planetary  missions  incorporating  the  use  of  robotic  gliders.  Such  outer  planet 
gliders  could  have  in-atmosphere  flight  endurance  an  order  of  magnitude  greater  than  that  achieved  by  atmospheric 
probes.  Such  longevity  would  allow  a  glider  to  function  as  a  radio  relay  link  for  a  short-lived  atmospheric  probe  targeted 
to  100  Bar  depths  as  recommended  by  the  National  Academy  of  Science28.  Returning  data  to  an  over- flying  orbiter  is  a 
major  problem  because  of  the  RF-attenuating  character  of  the  Outer  Planet  atmospheres  and  the  long  communicating 
distances  involved.  There  are  many  technical  challenges  inherent  in  the  development  of  such  vehicles,  not  the  least  of 
which  is  achieving  low  risk  in-atmosphere  gliding  or  soaring  flight  in  hurricane  force  winds.  The  development  of  such 
aerial  explorer  aeronautical  and  information  technologies  would  have  applications  to  terrestrial  environmental  sensing 
problems  as  well. 

Aerial  vehicle  concepts  for  the  exploration  of  outer  planet,  gas  giants  have  been  previously  examined11, 12.  Because  of 
the  higher  gravity  field  of  gas  giant  planets,  and  consequently  the  potential  energy  just  waiting  to  be  tapped,  gliders  are 
an  almost  obvious  design  solution  for  flight  in  the  atmosphere  of  gas  giant  planets.  Atmospheric  probes,  such  as  the 
Galileo  probe,  will  only  have  a  life  span  (once  released  into  the  atmosphere)  of  only  one  to  two  hours  at  best,  because 
ultimately  the  probes  descend  to  regions  of  such  great  pressure  and  temperature  conditions  that  their  failure  through 
crushing  or  heat  death  is  inevitable.  Such  atmospheric  probes  promise  only  a  hit  and  miss  approach  to  critical 
measurements.  A  robotic  glider  would  have  significantly  greater  longevity  than  probes  -  even  when  only  accounting  for 
conservative,  achievable  L/D’s  (lift  to  drag  ratios)  and  minimum  sink  rates.  Further,  if  the  outer  planet  gliders  were 
imbued  with  the  capability  of  performing  autonomous  dynamic  and  thermal  soaring  in  the  gas  giant  atmospheres,  then 
long  endurance  flight  duration  (limited  only  by  vehicle  battery  power)  is  potentially  achievable.  (Incorporation  of 
deployable  wind-turbine  devices  and/or  kinetic  rechargers  -  mass-spring  systems  for  drawing  energy  from  atmospheric 
turbulence  excitation  -  will  also  need  to  be  evaluated  as  to  their  ability  to  extend  vehicle  battery  life.)  Further,  the 
ability  to  execute  even  limited  maneuverability  would  allow  for  the  active  interrogation  and  measurement  of  atmospheric 
dynamics  of  these  planets  (by  means  of  Lidar  and  thermal  imaging,  techniques  which  will  likely  also  be  required  to 
achieve  autonomous  soaring). 

The  Galileo  atmospheric  probe  measured  winds  ranging  from  -200  miles  per  hour  at  the  one  bar  reference  altitude  to 
450  miles  per  hour  at  the  20  bar  altitude.  Outer  planet  gliders  will  have  only  limited,  but  essential,  control  as  they  are 
swept  along  by  the  winds  much  higher  than  even  severe  storm  wind  velocities  seen  on  Earth.  (Information  regarding  the 
Jovian  atmosphere  and  other  outer  planets  can  be  found  in  several  references13"17,  for  example.)  Currently,  progress  is 
being  made  to  employ  small  robotic  aircraft  to  monitor  terrestrial  hurricanes  and  severe  storms18'20.  Additionally,  other 


researchers  are  considering  from  an  information  technology  perspective  the  ability  to  perform  dynamic  and  thermal 
soaring  of  gliders21.  Further,  for  low-altitude  flight  (higher  atmospheric  pressure/density  levels),  the  trade-offs  between 
lift  generated  by  lifting- surfaces  and  buoyancy  can  also  be  examined.  In  this  regards,  the  lower-altitude  outer  planet 
gliders  might  take  on  “flight”  attributes  similar  to  underwater  autonomous  gliders22, 23 .  Such  past  technology  efforts  will 
aid  in  the  overall  effort.  The  extreme  range  of  temperatures  and  pressures  resulting  from  glider  flight  in  the  outer 
troposphere  of  the  outer  planet  gas  giant  atmospheres  dictates  the  development  and/or  validation  of  new  materials  and 
aircraft  construction  techniques.  One  such  approach  is  the  use  of  inflatable  wings  and  aircraft  structures24. 

Several  questions  exist  as  to  whether  or  not  such  outer  planet  glider  versions  of  aerial  explorers  are  viable.  First,  is  it 
possible  to  arrive  at  compact  (stowed  for  transport),  structurally  robust  glider  configurations  with  high  lift  over  drag 
ratios  and  therefore  low  minimum  sink  rates  compatible  with  flight  in  the  atmosphere  of  the  outer  gas  giant  planets? 
Second,  is  it  possible  to  defme/develop  adaptive  flight  control  laws  and  software  to  allow  autonomous  thermal  and 
dynamic  soaring?  Third,  can  these  glider  designs  and  autonomous  software  be  demonstrated  through  simulation  to 
allow  sustained  flight  in  hurricane  force  (or  greater  in  the  case  of  gas  giant  planets)  winds  and  turbulence? 

Different  vehicle  configurations  will  likely  be  required  for  different  bands  of  altitude  within  which  the  gliders  fly,  and  to 
which  purpose  they  are  employed  (Fig.  la-b).  For  example,  higher  altitude  gliders  for  the  1-10  Bar  pressure  reference 
altitudes  will  look  very  similar  to  terrestrial  gliders.  In  addition  to  weather  pattern  measurements,  such  higher  altitude 
gliders  could  also  serve  as  telecom  relays  for  probes  that  descend  to  deeper  depths.  Gliders  flying  deeper  into  an  outer 
planet  atmosphere,  as  the  low-altitude  flyer  seen  in  Fig.  lb,  would  have  lower  aspect  ratios,  more  compact  planforms, 
and  perhaps  derive  part  of  their  lift  from  buoyancy  effects  in  addition  to  wing  aerodynamic  lift.  All  outer  planet  glider 
concepts  would  be  subject  to  unique  design  challenges  such  as  stowing  and  transporting  them  in  aeroshell  entry  vehicles, 
then  deploying  or  releasing  upon  descent  through  the  planetary  atmosphere. 


Fig.  1.  Notional  Jovian  gliders:  (a)  “conventional”  glider  with  inflatable  wings  and  folding  tail  boom  and  (b)  lower-altitude  flyer. 


A  Mars  aerial  explorer  mission  that  might  take  on  greater  emphasis  in  the  future  is  one  where  atmospheric  samples  are 
taken  in-flight26.  Recent  spectroscopic  measurements  (from  the  ESA  Mars  Express  orbiter  and  from  ground-based 
telescopes)  suggest  that  there  may  be  unexpectedly  high  levels  of  methane  in  the  upper  atmosphere  of  Mars.  Whether 
the  source  is  biological  or  non-biological  is  subject  to  speculation.  An  aerial  explorer  outfitted  with  an  air-sampling 
device  and  spectroscopic  instruments  could  be  employed  to  pinpoint  the  sources  (at  the  surface  or  sub-surface)  of  the 
methane.  The  search  and  find  behaviors  of  such  a  methane  “sniffing”  aerial  explorer  would  be  very  reminiscent  of  the 
attributes  of  classic  computer  science  optimal  search  algorithms  (wherein  only  discrete  scale  measurements  can  be  made 
at  a  given  point  in  time  and  space).  These  air-sampling  search  behaviors  would  include  identifying  and  following  scalar 
gradients  of  methane  levels,  periodically  performing  various  perturbations  (zig-zagging,  spiral  patterns,  and  circling 
flight)  in  flight  path  to  make  sure  that  global  and  not  local  minima  are  being  pursued,  and  as  needed,  random 
commanded  waypoints  to  escape  regions  of  negligible  levels,  or  neutral  gradients,  of  atmospheric  methane. 


5.  AERIAL  EXPLORER  IMAGING/REMOTE-SENSING  TECHNOLOGY  NEEDS 


5.1  Intelligent  low  power  lightweight  sensors 

Aerial  explorers  will  require  an  integrated  suite  of  multiple  sensors,  to  include  vision,  spectrometers,  lidar,  radar,  and 
atmospheric-chemistry  sensors.  These  sensors  will  necessarily  have  dual  roles,  sharing  use  as  navigation  and  control  and 
as  science  sensors.  Such  a  sensor  will  also  need  to  be  intelligent,  having  both  the  ability  to  process  and  interpret  the 
datasets  on  board  to  a  higher  information  level,  and  also  to  self  adapt,  or  tune  itself  to  increase  the  ability  to  find  data  in 
the  area  in  which  it  finds  itself.  Table  2  is  a  notional  “wish  list”  of  such  sensors  as  applied  to  general  categories  of  aerial 
explorer  missions.  Only  the  “science  instruments”  are  noted;  sensors  for  navigation,  flight  control,  and  safety  of  flight 
health  monitoring  are  not  listed.  Severe  power  and  weight  constraints  will  have  to  be  met  (requiring  significant 
technology  investments  to  address  them)  in  order  to  enable  this  broad  suite  of  sensors  to  be  carried  by  the  aerial 
explorers  of  the  future.  There  is  a  clear  opportunity  by  the  imaging  and  remote  sensing  community  to  effect  the 
successful  realization  of  such  vehicles  and  missions  by  laying  the  early  technological  and  developmental  groundwork  to 
enable  these  sensors.  This  is,  in  part,  the  primary  purpose  of  this  paper.  Aerial  explorers  will  only  be  as  good  as  the 
sensors  they  carry. 


Table  2.  -  Wish  List  of  Smart  Sensors  and  their  Notional  Attributes. 


Sensors 

Attributes 

Ground  Sensing  and  Navigation 

Camera 

Can  image  downward,  forward,  and  off  axis. 

Can  Zoom. 

Can  automatically  track  specified  item  of  interest. 

Can  autonomously  create  and  return  a  mosaic  of  a  given  area. 

Spectrometer 

Can  image  downward,  forward,  and  off  axis. 

Can  successfully  image  at  wide  field  (to  show  general  existence)  and 
narrow  field,  (to  recognize  location) 

Can  automatically  track  specified  item  of  interest. 

Can  autonomously  create  and  return  a  2D  mosaic  of  a  given  area. 

Can  create  overlay  maps  of  different  spectral  images  in  parallel. 

Laser  and/or  Radar  altimeter 

Can  image  downward,  forward,  and  off  axis. 

Sensitive  to  sub  meter  accuracy. 

Can  autonomously  create  and  return  a  3D  map  or  mesh  of  a  given  area. 

Infrared  Sensor 

Can  image  downward,  forward  and  off  axis. 

Could  be  used  to  image  hydrothermal  vents. 

Could  be  used  to  image  glacier  areas  covered  by  dust  and  dirt. 

Ground  Penetrating  Radar 

Can  image  downward,  forward,  and  off  axis. 

Can  autonomously  create  and  return  a  3D  map  of  area. 

Can  return  surface  information  up  to  5  meters  below  the  ground. 

Magnetometer 

Could  provide2D  and  3D  models  of  magnetic  variance. 

Could  be  used  to  direct  aircraft  toward  the  existence  of  mineral 
deposits. 

Drop  Probe 

Ability  to  perform  close  up  and  micro  imaging  of  material  on  ground. 
Contact  sensors  capable  of  recognizing  different  chemical  compounds. 
Ability  to  provide  data  back  to  aerial  vehicle. 

Persistent  beyond  vehicle  flight. 

Tetherbot  Probe 

Probe  deployable  on  hillside  allowing  movement  of  sensors  up  and 
down  the  hill. 

Includes  cameras  that  can  recognize  rock  types  and  micro  image  rocks. 
Ability  to  provide  data  back  to  the  vehicle. 

Persistent  beyond  vehicle  flight. 

Ground  Penetrator  probe 

Can  penetrate  1-5  meters  below  surface  when  dropped  from  100 
meters. 

Contains  visual  sensors 

Contains  contact  sensors  to  perform  chemical  processes. 

Atmospheric  Environment  Sensing 

LIDAR 

Can  image  downward,  forward  and  off  axis. 

Provides  ranging  from  reflective  surfaces. 

Could  provide  backscatter  data,  allowing  2D  and  3D  models  of  terrain. 

Doppler  Radar 

Can  provide  advanced  warning  of  turbulence,  and  high  winds  to  allow 
advanced  flight  planning  and  maneuvering. 

Can  provide  3d  maps  of  weather  and  atmospheric  phenomena. 

Chemical  Spectroscopy  (methane,  other  chemicals) 

Would  provide  information  to  control  the  aircraft  toward  altitudes  or 
locations  where  specific  chemicals  exist. 

Would  provide  2D  and  3D  models  of  atmospheric  chemicals. 

Could  provide  2D  and  3D  models  that  could  be  used  to  predict 
emissions  emanating  from  ground  sources. 

Figures  2  and  3  show  graphics  from  initial  simulation  work  performed  by  our  team  to  examine  not  only  mission  design 
and  autonomous  system  technologies  for  aerial  explorers,  but  to  begin  to  investigate  questions  regarding  the  sensor  suite 
for  such  explorers.  Figure  2a-b  shows  the  vantage  viewpoint  of  two  different  camera  mountings  (forward-  and  sideward 
pointing)  for  a  Mars  fixed-wing  aerial  explorer.  The  explorer  model  in  the  simulation  is  a  generic  vehicle  configuration 
and  is  not  related  to  any  existing  concept. 


Figure  2.  (a)  forward-  and  (b)  sideward-pointing  camera  positions. 


Figure  3  shows  simulation  work  directed  towards  infrared  sensors  for  such  an  aerial  explorer.  Such  a  sensor  reflects,  in 
part,  an  interest  in  searching  for  hypothetical  surface  hydrothermal  vents  on  the  Martian  surface  (refer  to  the  reddish- 
orange  blotches  in  the  simulation  screenshot  and  window  inset). 


Figure  3.  Pan  and  tilt  infrared  camera  sensor  in  simulation. 


5.2 


Search  and  find  strategies  &  autonomy 


Planetary  aerial  vehicle  concepts  and  mission  scenarios  embody  technical  challenges  beyond  their  terrestrial 
counterparts,  the  increasingly  ubiquitous  UAV.  Unlike  terrestrial  UAVs  that  can  be  provided  with  scalable  autonomy 
(i.e.  varying  levels  of  human  operator  monitoring  and  intervention),  because  of  the  significant  light-time  delays, 
planetary  aerial  explorers  must  be  fully  autonomous  with  high  levels  of  mission  and  contingency  planning  capability. 

A  key  challenge  for  aerial  explorer  missions  is  to  how  to  maximize  scientific  return.  A  typical  aerial  mission  (perhaps 
covering  hundreds  or  thousands  of  kilometers)  might  have  a  duration  measured  in  hours  as  compared  to  months  for 
surface  rovers  and  years  for  orbiters.  Such  aerial  vehicles  may  need  to  survive  a  landing  and  continue  to  transmit 
recorded  data  and/or  to  act  as  a  fixed  surface  station.  Additionally,  the  aerial  explorers  could  air-deploy  and  distribute 
near  surface  features  of  interest  a  network  of  intelligent  sensors  and  small  robotic  devices.  In  both  cases  this  would  be 
the  ultimate  manifestation  of  entry,  descent,  and  landing  system  (EDLS)  technology.  Given  this  ability  to  survive 
landing,  the  aerial  explorer  then  becomes  an  element  in  a  system  of  sensors  and  robotic  devices,  key  components  that  are 
air-deployed.  In  effect,  the  mission  architecture  comprises  a  small  but  potent  robotic  ecosystem  of  heterogeneous 
robotic  systems,  both  internal  and  external  autonomous  agents. 

All  planetary  flight  vehicles  will  share  a  common  technology  requirement:  the  need  for  unprecedented  vehicle  autonomy 
to  perform  unique  science  missions  while  flying  in  relatively  unknown  environments.  Top-level  goals  are: 

1 .  Reliable  mission  capability  without  any  human  intervention  and  with  high-levels  of 
mission/contingency  planning  in  an  unknown/uncertain  environment; 

2.  Reliable/robust  solutions  for  precision  navigation  (non-GPS)  and  flight  control; 

3.  Robust  and  effective  robotic  system  of  systems  integration. 

Autonomous  system  technology  derived  from  this  proposed  program  will  become  the  “gold  standard”  for  uninhabited 
aerial  vehicles,  whether  terrestrial  or  planetary.  As  such,  there  should  readily  be  significant  adoption  of  concepts  and 
technologies  from  this  initiative  into  many  applications. 

An  important  ancillary  aspect  of  our  work  is  examining  how  bio-inspiration  can  yield  innovative  mission  concepts  and 
how  bio-inspired  autonomy  has  advantages  over  other  intelligent  systems  approaches2"8.  In  the  two  general  mission 
categories  identified  earlier,  bio-inspiration  leads  to  the  examination  of  the  behavioral  patterns  of  creatures  of  the  air  and 
those  of  the  sea.  Missions  entailing  surface  imaging  and  interaction  can  perhaps  best  draw  inspiration  from  the 
behaviors  of  creatures  of  the  air.  Those  missions  entailing  atmospheric  environment  sensing  might  be  best  served  by 
examining  the  behaviors  of  creatures  of  the  sea  (that  often  rely  on  three-dimensional  locomotion.  In  both  cases,  though, 
survival  of  these  creatures  is  highly  dependent  upon  keen  vision  or,  alternatively,  other  highly  attuned  senses. 

Table  3.  -  Representative  Parametric  Considerations  in  Developing  and  Evaluating  (in  Simulation)  Aerial  Explorer  Autonomy. 


Environment:  Atmospheric  Models,  Terrain  Models  (Actual,  Modeled,  Generated,  Generated  with  Actual  or  Modeled 

Insets),  Winds,  Weather,  Atmospheric  Flows. _ 

Aerial  Platforms:  Configuration,  Carrying  Capacity,  Dynamics,  Flexibility,  How  Deployed _ 

Resources:  Power,  Fuel,  Flight  Time,  Communication  Rates _ 

Onboard  Sensors:  Control  and  interface  with,  number,  type,  placement,  capacity,  dual  use  (navigation  and  science), 

sensor  models,  communication  rates,  processor  power,  “intelligence.” _ 

Deployable  Sensors:  Number  and  mix  of  sensors  carried  by  vehicle,  sensor  type,  sensor  capabilities  (contact,  video), 

communications  capability,  length  of  use  (persistence) _ 

Autonomous  Capabilities:  Data  analysis  capabilities,  autonomy  level8,  resource  management,  integrated  health 

management,  processing  speed,  processing  Supplemented  by  space-borne  assets. _ 

System  Architecture:  Single  Aircraft,  Multiple  Aircraft  (Sequential  or  Parallel  Flights),  Multiple  Aircraft  with  Different 

or  Complementary  Capabilities,  Flights  with  Ground  and/or  Space  Based  Assets. _ 

Mission  Methods  and  Goals:  Single  Mission,  Series  of  Missions,  Missions  with  Persistence. _ 

Resiliency  to  Failures  and  Contingencies:  Power  Failures  (Engine,  Batteries),  Communications,  Internal  and  External 
Pods,  Failure  of  one  or  more  aircraft. _ 


Table  3  is  a  short  representative  list  of  the  parametric  considerations  that  need  to  be  addressed  in  order  to  arrive  at  robust 
aerial  vehicle  autonomy  in  an  uncertain  or  unknown  environment.  This  is  the  minimum  condition  for  the  successful 
realization  of  aerial  explorers.  A  high  degree  of  confidence  must  be  established  (via  simulation  as  well  as  limited 
field/flight  demonstrations)  that  a  specific  mission  and  vehicle  design  combination  will  yield  scientific  success,  well 
before  a  launch  opportunity  would  become  available. 


5.3  Simulation  and  mission  design  for  intelligent  aerial  survey 

Planetary  aerial  vehicle  missions  will  present  unprecedented  challenges  as  compared  to  past  planetary  missions.  As 
noted  earlier,  in  many  ways,  planetary  aerial  vehicle  development  will  represent  the  “gold  standard”  for  UAV 
autonomous  system  technology.  Table  4  summarizes  a  notional  “wish  list”  of  autonomous  science  analysis,  flight 
control,  and  decision-making  software  and  simulation  capabilities  to  effectively  enable  the  development  of  future 
planetary  aerial  vehicles.  Inherent  in  this  software  and  simulation  wish  list  is  the  theme  of  bio-inspiration  as  applied  to 
mission  scenarios,  autonomous  flight  behaviors,  and  robotic  symbiosis  and  ecosystems. 


Table  4.  -  Wish  List  of  Onboard  Autonomous  Data  Analysis  and  Decision-Making  Software  Capabilities. 


Navigation  and  Flight  Control  - 

Ability  to  create  localized  maps  used  for  navigation. 

Autonomous  target  and  feature  tracking 

Ability  to  close  flight  control  around  sensors  (sensors  direct  the  vehicle’s  flight) 

Ability  to  fly  random  and  intelligent  random  patterns. 

Mission  Decision-Making  - 

Management  of  resources  of  time,  altitude,  energy,  communications,  processing  resources,  deployable  devices. 

Mission  Management  —  Manages  ultimate  goals  and  decision  making  of  mission. 

Management  of  multiple  science  hypotheses  with  the  ability  to  follow  or  discard  as  needed  as  the  flight  progresses. 

Science  Discovery  - 

Ability  to  specify  a  science  hypothesis  and  the  process  necessary  to  follow  it,  including  sensors  and  analyses  needed,  possible 
alternatives,  flight  altitudes. 

Data  Analysis  and  Sensor  Operation 

Sensor  Data  Coordination  and  Integration  -integrates  data  from  multiple  sensors  to  support  hypothesis  following. 

Creation  of  a  three-dimensional  surface  topography  map  using  multiple  cameras  and  continuous  image  sequences  from  vehicle 
over-flight. 

Can  recognize  and  return  a  terrain  to  include  individual  rocks. 

Sensor  Operation  -  Operation  of  sensor  to  include  pointing,  focus,  and  generation  of  2D  and  3D  data  representations. 
Communicates  and  coordinates  with  Vehicle  operator. 

Autonomous  set  up,  gain/filter  adjustment,  and  calibration/recalibration  of  sensors  for  use. 

“Pod  Technician”  -  Manages  status  of  pods  and  does  any  preparation  of  the  pod. 

Ideally  a  combination  of  simulation  and  flight  test  demonstrations  of  aerial  vehicle  technologies  could  be  accomplished 
prior  to  mission  design  finalization  and  launch.  As  there  will  be  considerable  difficulty  in  finding  analog  environments 
for  vehicle  terrestrial  flight  demonstrations,  much  of  the  mission/vehicle  design  and  evaluation  will  have  to  be  borne  by 
simulation  analysis.  (For  example,  an  aerial  vehicle  would  have  to  fly  at  an  altitude  of  over  lOOkft  on  Earth  to  match  the 
mean  atmospheric  density  at  Mars’  surface.  Accomplishing  such  flight  demonstrations  are  very  costly  and  difficult  to 
perform.)  Nonetheless  it  is  important  to  acknowledge  the  limitations  of  simulation  for  such  purposes:  models  might  not 
match  actual  characteristics  of  the  vehicle,  the  environment,  the  overall  mission  constraints;  simulation  models  can  only 
be  tested  to  some  inevitable  fidelity  level  less  than  actual;  models  need  to  be  validated  as  much  as  possible  (even  if  there 
is  a  non-optimal  match  between  the  planetary  and  terrestrial  analog  environments  and  the  mission  and  demonstration 
scenarios). 

To  support  our  research,  we  have  developed  the  Reflection  architecture  and  simulator7  which  allows  real  and  fast  time 
simulations  of  vehicles,  sensors,  and  software  in  terrestrial  and  planetary  environments.  Using  an  open,  flexible 
architecture,  Reflection  allows  simulation  components  and  software  to  be  easily  integrated  as  necessary  to  meet  a 


mission  design.  The  atmosphere,  flight  models,  terrain,  and  target  distributions  are  all  variable.  In  addition,  the 
Reflection  architecture  allows  simulation  to  be  executed  on  the  target  hardware  in  the  lab  as  well  as  on  the  vehicle  while 
in  flight.  Simulations  can  be  evaluated  first  in  the  3D  visual  environment  and  then  run  offline  hundreds  of  times  in  the 
same  or  different  simulation  conditions.  Figure  4  shows  a  typical  screen  shot  during  a  simulation  run.  This  system  was 
used  for  the  development  of  the  autopilot  study  described  later  in  this  paper. 


Figure  4.  Reflection  Simulator  Interface  showing  vehicle,  terrain,  and  autonomous  software  monitoring  displays. 

5.4  Getting  the  data  back  home 

As  seen  for  their  ground-based  relatives  (i.e.,  robotic  rovers),  voluminous  data  sets  will  likely  be  the  norm  for  aerial 
vehicle  planetary  science  missions.  However,  unlike  rover  missions,  there  will  be  no  scientist  existing  in  the  mission 
execution  loop.  Like  their  ground  based  relatives,  planetary  aerial  vehicles  will  need  to  be  able  to  access  and  sample  the 
environment  so  that  they  can  confirm  or  deny  hypotheses  as  they  go  along.  They  will  need  to  deploy  pods  that  can  reach 
the  ground  and  return  data,  or  surrogate  air  vehicles  that  can  fly  to  lower  or  higher  altitudes  to  sample  areas  that  would 
be  physically  impossible. 

Even  if  the  planetary  aerial  vehicle  meets  all  its  design  and  mission  objectives,  there  are  still  considerable  remaining 
challenges  to  address.  First  and  foremost  is  the  challenge  of  getting  the  acquired  imaging  data  back  to  Earth.  Because 
of  the  data  demands,  and  the  likely  available  communication  resources,  the  vehicles  and  probes  must  intelligently  filter 
the  data  that  they  gather  and  maintain.  Rather  than  necessarily  gigabytes  of  data,  the  information  that  they  would  return 
back  to  earth  might  largely  consist  of  the  tested  hypotheses  and  the  data  that  supported  or  invalidated  them.  Because  the 
vehicle  may  not  be  able  to  fly  and  communicate  at  the  same  time,  the  vehicle  will  need  to  be  highly  robust,  capable  of 
surviving  a  crash  landing  and  then  processing  and  returning  the  data  that  has  been  gathered. 


6.  INITIAL  SIMULATION  RESULTS  FOR  MISSION  &  IMAGING  SYSTEM  DESIGN 

Simulation  has  become  an  invaluable  tool  for  designing  and  evaluating  imaging  systems  for  NASA  Mars  robotic 
rovers29.  In  a  similar  manner,  the  work  noted  in  this  paper  takes  initial  steps  towards  developing  simulation  tools  for 
imaging  surveys  for  planetary  aerial  vehicles.  Given  the  likely  high  costs  of  developing  missions  for  such  planetary 
aerial  vehicles,  it  is  essential  to  arrive  at  robust,  flexible  aerial  imaging  systems.  The  following  simulation  experiment 
shows  the  utility  of  using  simulation  to  test  and  develop  control  systems  for  aerial  exploration. 


6.1  Closing  the  Loop  around  Sensors 


Our  hypothesis  in  designing  the  control  systems  used  in  these  experiments  was  that  the  explorer  would  perform 
substantially  better  when  sensor  information  was  taken  into  account,  and  a  system  that  could  balance  between  several 
different  strategies  would  outperform  a  system  that  would  use  a  single  search  behavior,  regardless  of  apparent  success. 


Figure  5.  Views  of  simulated  terrain:  Overhead  (Left),  river  plain  (center),  image  showing  depth  of  river  (top  right),  % 

view  showing  extent  of  river. 

The  environment  used  in  our  simulation  consisted  of  a  large  featureless  terrain  with  the  exception  of  a  large  gully  that 
runs  randomly  through  it,  as  shown  in  Figure  5.  The  entire  search  area  is  180,000  square  miles,  with  75  targets 
distributed  randomly  in  the  environment  based  on  three  distribution  strategies:  (i)  1/3  of  the  targets  are  randomly 
distributed  over  the  entire  search  area;  (ii)  1/3  of  the  targets  were  randomly  distributed  but  concentrated  near  the  gully 
based  on  a  Gaussian  distribution;  and  iii)  1/3  of  the  targets  are  distributed  based  on  a  random  blend  between  (i)  and  (ii). 

We  simulated  an  aerial  explorer  cruising  at  Mach  0.7  in  the  Martian  atmosphere  at  an  altitude  of  5000  ft,  with  a  total 
search  time  of  1  hour  (which  is  optimistic  given  estimates  in  the  literature).  We  also  developed  five  behavioral  search 
strategies  whose  success  is  dependent  on  the  distribution  of  targets  in  the  environment,  as  detailed  in  table  5. 

Table  5.  Flight  exploration  behaviors  and  success  heuristics. 


Behavior 

Heuristic 

Grid  Search 

Targets  concentrated  in  an  area  (directionally) 

Spiral  Search 

Targets  concentrated  in  an  area  (non-directionally) 

Terrain  Following 

Targets  are  concentrated  in  the  dried  riverbed 

Random  Walk 

Targets  are  uniformly  distributed  over  entire  area 

Emotional  CEL  Network 

Combines  random-walk  and  terrain-following,  with  neither  being  favored. 

The  experiment  simulates  a  downward  facing  camera  that  captures  an  image  when  the  aircraft  is  3.7  km  from  the 
location  where  the  previous  snapshot  was  taken,  as  the  aerial  explorer  traverses  the  terrain.  The  camera  has  an  aspect 
ratio  of  1:1,  with  a  field  of  view  angle  of  60  degrees,  capturing  images  as  large  4  km  per  side  depending  on  the  terrain 
height.  In  addition  to  returning  images,  the  camera  area  was  used  to  identify  whether  the  targets  of  interest  were  visible 
to  the  aircraft  at  any  time.  Figure  6  shows  examples  of  the  five  behaviors  and  the  image  records  they  produced.  Figure  7 
shows  close  ups  of  the  image  coverage  of  three  of  the  behaviors. 


Figure  6.  Graphical  Imaging  of  Search  Area  using  Experimental  Search  Behaviors. 

(a)  Grid  Search  (b)  Spiral  Search  (c)  Terrain  Following  (d)  Random  Walk  (e)  CEL  System 


Figure  7.  Close  up  detail  of  simulated  aerial  vehicle  imaging:  Grid  (upper  left),  Spiral,  Slope  following  (bottom  left). 

We  used  the  behaviors  to  close  the  loop  between  sensor  information  and  flight  controls  in  order  to  maximize  the  goal  of 
identifying  targets.  The  grid  and  circling  behavior  searches  in  Figure  6  (a)  and  (b)  and  7  represent  a  traditional  waypoint 
commanded  control  system  with  decoupled  sensor  and  downward  facing  camera.  The  results  of  the  experiments 
performed  with  these  autopilots  showed  that  they  did  no  better  than  a  random  walk  of  the  area  (Figure  6  (d))  as  shown  in 
Figure  8. 
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Figure  8.  Experimental  results  showing  rocks  identified  per  hour  using  5  different  control  search  strategies. 

A  terrain  following  autopilot  was  then  designed  that  closed  the  loop  on  an  auxiliary  sensor,  (laser  altimeter),  since  terrain 
altitude  is  an  indirect  indicator  of  the  target  distribution.  The  autopilot  performed  substantially  better  than  the  original 
autopilots  as  shown  in  Figure  8,  which  supported  the  first  part  of  our  hypothesis  on  closing  the  loop  on  sensor 
information.  However,  the  autopilot  would  often  miss  opportunities  to  image  targets  that  were  slight  outliers,  as  shown 
on  the  left  image  of  Figure  9.  The  amount  of  uncertainty  in  the  distribution  (deviation  in  the  normal  distribution  about 
the  riverbed)  has  a  large  effect  on  the  success  of  the  slope  following  autopilot,  and  when  targets  are  randomly  generated 
without  regard  to  terrain  height,  the  slope  following  performs  no  better  than  the  random  walk.  This  kind  of  uncertainty  is 
expected  to  be  an  aspect  of  planetary  exploration;  if  there  is  certainty  about  the  environment  and  existence  of  target 
objects,  there  would  be  no  need  to  perform  the  search. 


Figure  9.  Imaging  Performed  by  Terrain  Following  (Left)  and  CEL  Autopilot  (Right). 
Dashed-Line  Indicates  Location  of  Riverbed.  Red  Circles:  Unidentified  Targets.  Yellow  Circle:  Imaged  Targets. 


Our  final  application  was  to  examine  better  ways  of  managing  search  behaviors  in  flight  for  the  adaptive  selection  of  the 
best  behavior.  An  emotional  flight  control  system  (EFCS)  was  created  using  the  CEL  architecture9.  This  autopilot 
manages  internal  states  as  a  dynamic  system  that  responds  to  continuous  and  discrete  inputs  from  the  sensors,  closing  the 
loop  on  both  the  laser  altimeter  (indirect  sensor,  continuous)  and  the  camera’s  visual  identification  software  (direct 
sensors,  discrete).  Using  this  additional  sensor  information  in  the  autopilot,  the  EFCS  would  rely  on  a  combination  of 
the  previous  behaviors,  selecting  the  behavior  that  seemed  most  appropriate  given  the  discrete  feedback  received  from 
the  camera  sensors.  As  hoped,  the  resulting  system  outperformed  the  less-intelligent  terrain  following  autopilot  as 
shown  in  Figure  9,  although  the  results  exhibited  a  larger  standard  deviation  than  the  experiments  performed  with  the 
previous  autopilots. 

It  is  anticipated  the  CEL  architecture  will  find  broad  application  to  a  number  of  robotics  and  UAV  problems,  as  well  as 
extensible  to  other  flight  behaviors  and  heuristic  rules  for  discovery  of  terrain  features  of  interest.  It  is  also  anticipated 
that  the  CEL  architecture  and  bio-inspired  autonomy  in  general,  is  well-suited  to  the  two  general  aerial  explorer  mission 
categories  addressed  in  this  paper,  though  the  work  to  date  has  focused  on  the  surface  imaging  and  interaction  mission 
category.  Much  more  work  is  required  and,  hopefully,  will  be  carried  out  in  the  future. 


8.  CONCLUDING  REMARKS 

It  is  a  powerful  vision  that  one  day  aerial  vehicles  will  fly  through  the  skies  of  other  planetary  bodies  in  our  Solar 
system.  However,  having  made  that  somewhat  bold  prediction,  it  is  essential  that  the  scientific  return  on  investment  of 
such  planetary  aerial  vehicle  missions  is  maximized.  This,  in  part,  dictates  that  optimal  solutions  both  from  an 
instrument  (i.e.,  cameras  and/or  other  remote-sensor  “imaging)  as  well  as  an  autonomy  perspective  be  developed  and 
demonstrated.  This  in  turn  will  require  that  a  new  approach  to  mission  simulation  for  aerial  explorers  will  be  necessary. 
This  paper  has  outlined  the  initial  requirements  for  aerial  explorers  conducting  aerial  surveys;  further,  it  has  provided 
sample  results  from  preliminary  simulation  work  related  to  such  aerial  explorer  survey  missions.  The  results  to  date  are 
quite  promising  and  steps  towards  future  work  are  outlined. 
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